NSF definition from Goodman et al (Science 2016): Reproducibility refers to the ability of a researcher to duplicate the results of a prior study using the same materials as were used by the original investigator.
Do we agree?
Perhaps we should be talking about “Methods Reproducibility”
It is not the truth, or even an approximation of truth Reproducing the same bias/mistake = same (wrong) results
If most researchers think this is important,
why are we not working reproducibly?
What are the obstacles?
Think-Pair-Share
http://www.socrative.com
Student login, Room Name :AHREN
*I will add a picture for this later…
http://www.socrative.com
Student login, Room Name :AHREN
F: Fusion - Fusing the topic with bad thoughts about failure:
“I can not do this”
“It is too hard”
“It will take me too long time”
E: Excessive Goals - We get excited and want to change everything immediately
This leads to to unrealistic expectations and a high risk of failure!
Hard to keep up long term
A: Avoidance of Discomfort - All types of change will feel uncomfortable and unfamiliar at first
Avoiding discomfort, taking the easy way out (=no change)
Change is scary!
R: Remoteness from Values - Easy to loose goal and purpose
“Why am I even doing this?”
Note: Get organised! does not help!
Time: 10 minutes plus time for sharing
Make a mind map to visualise the process of one of your projects.
Be as detailed as you can regarding files needed and produced. Is external data required?
How would you like to structure this project? Draw a management plan on a new piece of paper.
Include files, folder structure, project structure and external resources required
Put the two pieces of paper up for viewing by others.
I always add the following directories/folders into the project directory:
Read-only, raw data and meta data
This is an exact COPY of the data at the start of the project
Make a separate folder for each of the steps in the analysis I like to number them to get a nice order
Put documentation (e.g Rmarkdown, Notes etc)
Scripts, such as sbatch, bash, R scripts etc
Store software installed locally, also keep source code
Think-Pair-Share
http://www.socrative.com
Student login, Room Name :AHREN
Comments?